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Background: Different assays, including the competitive Luminex immunoassay (cLIA), 
secreted alkaline phosphatase neutralization assay (SEAP-NA), and virus-like particle-based 
ELISA, are commonly used to measure antibody responses after human papillomavirus 
(HPV) vaccination. Direct assay comparisons aid interpretation of immunogenicity data 
evaluated by different assays. 

Methods: We compared cLIA to SEAP-NA and ELISA among 51 HPV16/18-vaccinated 
women enrolled in the Costa Rica Vaccine Trial. We tested replicate serum samples col- 
lected at months 0, 1 , and 12 by HPV16/18 cLIA, SEAP-NA, and ELISA. For a subset (A/= 10), 
we further tested month 6, 24 and 36 samples. We calculated seroprevalence estimates 
and Spearman rank correlation coefficients comparing cLIA to SEAP-NA and ELISA. 

Results: After one vaccine dose, seroprevalence by SEAP-NA and ELISA was 100% (both 
HPV16 and HPV18), and by cLIA was 96% (95% CI 87-100%) for HPV16 and 71 % (95% 
CI 56-83%) for HPV18. Seroprevalence was 100% by all assays after three doses. Corre- 
lation between assays was high after one vaccine dose [cLIA/SEAP-NA p = 0.91 (HPV16) 
and p = 0.86 (HPV18); cLIA/ELISA p = 0.84 (HPV16) and p = 0.74 (HPV18); all p < 0.001 ] and 
remained high through month 36. Ratios of mean antibody levels to seropositivity cutoffs 
at month 36 were lower for cLIA than for SEAP-NA or ELISA, particularly for H PV1 8 (H PV1 8 
ratio for cLIA 1.9, SEAP-NA 3.5, ELISA 3.4). 

Conclusion:Though correlation between cLIA and SEAP-NA/ELISA is high and stable after 
vaccination, the assays differ in scale and sensitivity, with notable differences after one vac- 
cine dose and for HPV18. Our results demonstrate that comparisons of antibody responses 
to HPV vaccination measured by different assays are approximate, and must consider 
biological and technical differences between assays. 
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INTRODUCTION 

Two human papillomavirus (HPV) virus-like particle (VLP) 
vaccines, the bivalent (HPV16/18) Cervarix® and quadrivalent 
(HPV6/11/16/18) Gardasil®, are licensed for prevention of cer- 
vical cancer and related lesions (1). Four-year efficacy of both 
vaccines approaches 100% among HPV-naive women for preven- 
tion of high-grade lesions related to HPV types 16 and 18 (2, 3), 
which together cause 70% of cervical cancers (4). 

Neutralizing antibody responses are believed to be the pri- 
mary mechanism of vaccine-induced protection (5), but different 
type-specific assays are used to measure them. For Cervarix®, the 



principal assay for measuring immunogenicity has been the VLP- 
based ELISA, which measures neutralizing and non -neutralizing 
antibodies of one immunoglobulin class (typically IgG). Neu- 
tralizing responses to Cervarix® have been measured using the 
secreted alkaline phosphatase neutralization assay (SEAP-NA), 
which broadly and directly measures neutralization potential (6). 
For Gardasil®, the proprietary competitive Luminex immunoassay 
(cLIA) is primarily used, which measures neutralizing antibodies 
that compete for binding to one VLP epitope (7). 

Measured antibody responses are important, as they are used 
as evidence of vaccine immunogenicity, but results vary by assay. 
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When different vaccines are evaluated using different assays, vari- 
ability in results may be due to assay differences or due to true 
differences in immunogenicity (8). To facilitate interpretation of 
measurements by different assays, direct comparisons of assays 
have been published in both natural infection and vaccination con- 
texts (9-12). A previous report by our group compared SEAP-NA 
to ELISA after vaccination with Cervarix® , finding high correlation 
between the two assays (10). Here, we extend these results by pre- 
senting a detailed and longitudinal post-vaccination comparison 
of cLIA to SEAP-NA and ELISA. 

MATERIALS AND METHODS 

We evaluated women selected from the HPV vaccine arm of the 
Costa Rica Vaccine Trial (CVT) (13), in which participants were 
vaccinated with Cervarix® at months 0, 1, and 6. For the present 
study, we combined two groups of women sampled for previous 
serological studies where HPV16/18 SEAP-NA and ELISA test- 
ing were already performed (10, 14, 15). The first group included 
50 randomly sampled women, and the second group included 12 
women sampled with the requirement of no cervical infection with 
HPV types 16, 18, 31, 45, or 58 at baseline (month 0). We further 
tested replicate sera from these 62 women collected at months 0, 
1, and 12 by HPV16/18 cLIA; for the smaller group, we addition- 
ally tested samples from months 6, 24 and 36. We excluded four 
women who received fewer than three vaccine doses and five for 
whom any of the assays failed, and further excluded two women 
with anomalous results in post-vaccination samples. One woman 
was seronegative by all assays at month 12 despite a normal anti- 
body response at other time points; we suspect this may reflect 
a sample retrieval error. The second woman never seroconverted 
by HPV 16/ 18 cLIA after vaccination; this may indicate a technical 
error but does not imply a vaccine failure as other assays showed 
the expected antibody response. As results did not differ by group, 
we conducted analyses among a combined analytical sample of 51 
women, equal to 62 less 1 1 exclusions. 

The SEAP-NA was performed at the HPV Immunology Lab- 
oratory, SAIC-Frederick Inc., as described (6, 10), with results 
reflecting the mean of at least duplicate testing (maximum of 
15 runs) for each sample. Neutralization titers were calculated 
by linear interpolation and were defined as the reciprocal of the 
dilution that reduced SEAP activity by 50% compared to control 
wells. We used the laboratory- determined seropositivity cutoff 
of 10, which reflects our lowest dilution. The VLP-based ELISA 
was performed at GSK Biologicals as described (16), with results 
reflecting the mean of between 1 and 5 runs per sample, and 
laboratory- determined seropositivity cutoffs of 8 EU/mL (ELISA 
units per milliliter) (HPV16) and 7 EU/mL (HPV18) were used. 
Data describing our ELISA (10) and SEAP-NA (10, 14, 15) results 
have been published. The cLIA was performed at PPD Vaccines 
and Biologicals as described (7), with use of standard curves to 
convert mean fluorescence intensities to arbitrary milli-Merck 
units per milliliter (mMU/mL). Laboratory-determined cutoffs of 
20mMU/mL (HPV16) and 24 mMU/mL (HPV18) are based on 
an algorithm maximizing the distinction between "likely negative" 
and "likely positive" samples (17). 

We performed statistical analyses separately for HPV 16 and 
HPV18. Among the combined sample of 51 women, at months 



0, 1, and 12, we compared cLIA to SEAP-NA and ELISA using 
seroprevalence estimates, scatter plots, and Spearman rank corre- 
lation coefficients. Among the subgroup of 10 women (12 less 2 
exclusions), where we additionally had assay data at months 6, 24 
and 36, we plotted individual antibody levels by each assay over 
time. To quantify inter- assay correlation beyond month 12 (i.e., 
beyond time points available in the larger sample), we also calcu- 
lated Spearman coefficients at month 36 among these 10 women. 
For graphical presentation and calculation of correlation coeffi- 
cients, values below assay lower limits of detection (LLODs) were 
assigned a value of 1/2 (LLOD). 

RESULTS 

HPV 16/ 18 antibody levels increased after vaccination as previ- 
ously reported by SEAP-NA and ELISA (10, 14, 15) and by cLIA 
(Figures 1 and 2) . At 1 month after the first vaccine dose, all women 
were HPV16 and HPV18 seropositive by SEAP-NA and ELISA 
(Table 1). By cLIA, at month 1, 96% (95% CI 87-100%) and 
71% (95% CI 56-83%) were seropositive for HPV16 and HPV18, 
respectively. At month 12, all women were seropositive for both 
HPV types by all three assays. 

Prior to vaccination, when average antibody levels were very low 
or below detection limits, correlation between cLIA and SEAP-NA 
was moderate for HPV16 (p = 0.39, p = 0.004, Figure lA) and 
not present for HPV18 (p = -0.04, p = 0.774, Figure IC). Results 
were similar for cLIA and ELISA (p = 0.58, p < 0.001 for HPV16; 
p = -0.07, p = 0.629 for HPV18, Figures 1B,D). Correlation was 
high after one vaccine dose (i.e., at month 1), with Spearman 
coefficients of 0.91 (HPV16) and 0.86 (HPV18) for cLIA and 
SEAP-NA, and coefficients of 0.84 (HPV16) and 0.74 (HPV18) 
for cLIA and ELISA (all p < 0.001). Correlation remained high 
6 months after the third dose (i.e., at month 12), with Spearman 
coefficients of 0.79 (HPV16) and 0.87 (HPV18) for cLIA and 
SEAP-NA, and coefficients of 0.81 (HPV16) and 0.86 (HPV18) 
for cLIA and ELISA (allp < 0.001). Discordant samples (i.e., sam- 
ples seronegative by one assay but seropositive by the other) were 
present only at months 0 and 1, and were seronegative by cLIA but 
seropositive by either SEAP-NA or ELISA in all cases (Figure 1). 
Using data at month 36 (N = 10), when plateau antibody levels are 
expected, correlation coefficients were 0.89 (HPV16, p = 0.001) 
and 0.83 (HPV18, p = 0.003) for cLIA and SEAP-NA, and 0.96 
(HPV16, p < 0.001) and 0.92 (HPV18, p < 0.001) for cLIA and 
ELISA (results not shown). 

Antibody kinetics throughout and after vaccination were 
largely similar across HPV types, assays, and the 10 women studied 
(Figure 2), with increases in antibody levels throughout vac- 
cination and a gradual decline after month 12. For HPV 16/ 18 
SEAP-NA and ELISA, levels were well above seropositivity cut- 
offs beginning at month 1 (Figures 2C-F). For cLIA, particu- 
larly for HPV18, levels were lower and closer to the seropos- 
itivity cutoff (Figures 2A,B). To quantify this observation at 
our final time point (month 36), we calculated the ratio of 
the mean of log- antibody levels to the corresponding log- cutoff 
(log-antibodymean: log-cutoff). For HPV16, these ratios were 2.4 
for cLIA, 3.4 for SEAP-NA, and 3.6 for ELISA. For HPV18, 
these ratios were 1.9 for cLIA, 3.5 for SEAP-NA, and 3.4 for 
ELISA. 
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FIGURE 1 I Antibody levels for HPV16 (A,B) and HPV18 (C,D), as 
measured by cLIA vs. SEAP-NA (A,C) or cLIA vs. ELISA (B,D) Levels 
were measured at months 0 (white markers), 1 (gray markers), and 12 
(black markers) among 51 women in the Costa Rica Vaccine Trial who 
received HPV vaccine doses at months 0, 1, and 6. Spearman rank 



correlation coefficients between pairs of assays are displayed for each 
time point, with asterisks denoting statistical significance (all p < 0.005). 
Dashed lines represent laboratory-determined seropositivity cutoffs. Note 
differing scales for x- and /-axes, as assays use different scales for 
measurement. 



DISCUSSION 

Different assays are used to monitor antibody responses following 
HPV vaccination, with ELISA or SEAP-NA typically used for Cer- 
varix® and cLIA for Gardasil®. To aid interpretation of immuno- 
genicity data, we directly compared cLIA-measured responses to 
ELISA- and SEAP-NA-measured responses after vaccination with 
Cervarix®. Correlation between cLIA and both SEAP-NA and 
ELISA was high beginning after one vaccine dose, with similar 
antibody kinetics across assays. However, levels relative to seropos- 
itivity cutoffs were lower by cLIA than by SEAP-NA or ELISA, 
particularly for HPV18. 

The cLIA, SEAP-NA, and ELISA are technically different assays 
and measure different aspects of the antibody response (8). The 
cLIA measures neutralizing antibodies of all immunoglobulin 
classes that compete for binding to a specific VLP epitope ( V5 for 
HPV16, J4 for HPV18) by evaluating the strength of a fluorescent 
signal produced by binding monoclonal antibodies (7). SEAP- 
NA measures a reporter gene product which is expressed when 
HPV pseudovirions infect susceptible cells, such that decreases in 



expression reflect overall serum neutralizing potential (6), which 
is assumed but not required to be antibody-mediated. ELISA mea- 
sures one class of antibodies (typically IgG) that bind to a fixed VLP 
antigen by measuring the activity of an enzyme conjugated to a 
secondary antibody (16). These assays use different scales in terms 
of measurement, and further differences exist in the structure and 
production of the VLPs for each assay. The directed nature and 
more stringent cutoff of cLIA affords it lower sensitivity than 
SEAP-NA or ELISA (9); further, within the cLIA, the HPVl 8 J4 epi- 
tope may be less immunodominant than the HPV 16 V5 epitope. 

In our study, the lower sensitivity of cLIA was likely responsible 
for a number of discordant samples after vaccination. At month 1, 
approximately 4% of samples were HPV 16 seropositive by ELISA 
and SEAP-NA but HPV 16 seronegative by cLIA. The proportion 
of discordant samples was larger (29%) for HPVl 8 at the same 
visit, likely reflecting lower immunodominance of the HPV 18 J4 
epitope than the HPV16 V5 epitope. Relative to seropositivity cut- 
offs, HPV 18 antibody levels were substantially lower by cLIA than 
by SEAP-NA or ELISA. 
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FIGURE 2 I Individual patterns of antibody levels over time as measured 
by cLIA (A,B), SEAP-NA (CD), and ELISA (E,F) among 10 women in the 
Costa Rica Vaccine Trial who received HPV vaccine doses at months 0, 1, 

and 6. Patterns are shown for HPV16 (A,C,E) and HPV18 (B,D,F). Bold solid 



lines represent seropositivity cutoffs, and ratios at 36nnonths were calculated 
as the mean of log-antibody levels to the log of the corresponding 
seropositivity cutoff. HPV DNA negativity for types 16, 18, 31 , 45, and 58 at 
month 0 was required for selection. 



Despite assay differences, we observed high and statistically sig- 
nificant correlation between cLIA and both SEAP-NA and ELISA 
beginning after one vaccine dose and extending to month 36, 
with similar antibody kinetics across HPV types and assays. A 
previous study, comparing cLIA to an in-house SEAP-NA, found 
correlation coefficients of 0.67 (HPV16) and 0.91 (HPV18) 1 
month after the third dose of Gardasil® (12). Another study 
conducted among Gardasil® vaccinees compared cLIA to a total 



IgG Luminex immunoassay, which is biologically similar to but 
technically different from our ELISA (18). Results were similar 
to our cLIA/ELISA comparison, with correlation coefficients at 
months 7, 24, and 48 of 0.66, 0.90, and 0.91 for HPV16, and 0.84, 
0.88, and 0.89 for HPV18. Our group previously reported high 
correlation between SEAP-NA and ELISA for combined 1- and 
12-month measurements, with coefficients of 0.91 (HPV16) and 
0.85 (HPV18) (10). 
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Table 1 | Seroprevalence by HPV type, assay, and visit among 51 
women in the Costa Rica Vaccine Trial. 



HPV type Assay Seroprevalence and 95% confidence 

interval^ (%) 







Month 0 


Month 1 


Month 12 


HPV16 


cLIA 


4(0-13) 


96 (87-100) 


100 (93-100) 




SEAP-NA 


33 (21-48) 


100 (93-100) 


100 (93-100) 




ELISA 


12 (4-24) 


100 (93-100) 


100 (93-100) 


HPV18 


cLIA 


0 (0-7) 


71 (56-83) 


100 (93-100) 




SEAP-NA 


8 (2-19) 


100 (93-100) 


100 (93-100) 




ELISA 


20 (10-33) 


100 (93-100) 


100 (93-100) 



Seropositivity was defined according to laboratory cutoffs (see IVIaterials and 
Metlnods). l-iPV vaccine doses were administered at montfis 0, 1, and 6. 
^ For estimates wliere seroprevalence isOor 100%, a one-sided 97.5% confidence 
interval is shown. 



In conclusion, though agreement between assays is not high 
prior to vaccination (9), among vaccinated women measurements 
by cLIA, SEAP-NA, and ELISA correlate well and have similar 
patterns over time. However, the assays differ in scale and sensitiv- 
ity, with notable differences after one vaccine dose and for HPV18. 
Comparisons of antibody responses to HPV vaccination measured 
by different assays are therefore approximate, and must consider 
biological and technical differences between assays. 
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